Teaching Lab End of Year Report: IL_Chicago Public Schools_Network 4

2022-2023 End of Year Report

Background

Teaching Lab collects a variety of data to understand the impact of its PL for educators and students. Please see this resource for a visual overview of our evaluation framework. Additionally, the narrative of our evaluation plan provides more details.

To date (Jun 06, 2023), Teaching Lab has collected the following data during SY22-23:

  • 11 complete responses to the Ongoing Coaching section of the survey that gathers participant feedback on each Coaching session;
  • 3complete responses to the End of Coaching section of the survey that gathers participant feedback on each Coaching performance;
  • 24 complete responses to the first Knowledge or Self-Reported Practices Assessments and 0 to the second Knowledge or Self-Reported Practices Assessments;
  • 20 complete responses to the Baseline Diagnostic Educator Survey that collects information on teachers’ use of curricula, mindsets, self-reported practices, and school environment & 3 responses to the Follow-up Educator Survey.
  • 25 observations of classroom instruction.
  • 55 high quality samples of student work.

Below we have compiled the results in various sections: Participant Background and Demographics Summary, Participant Perceptions, Participant Knowledge, Teachers’ Mindsets & School Environment, School Leaders’ Mindsets & Observational Practices, Instructional Practice and Student Outcomes.

Section 1: Participant Background and Demographics Summary

This section provides a demographic and background summary on participants.

Gender and Racial Identity

Years of Teaching Experience

Content Area

Grades

Prior Experience with Teaching Lab Professional Learning

Roles

Section 2a: Ongoing Coaching Feedback

Aggregate

All Races

In summary, we see the following % agree or strongly agree with the above statements:

  • 73% strongly agree or agree that the coach seemed fully prepared for the coaching sessions.

  • 73% strongly agree or agree that the coaches made necessary adjustments based on their needs.

  • 91% strongly agree or agree that the coaches effectively built a safe learning environment.

  • 91% strongly agree or agree that the coaches demonstrated deep knowledge of the content they coach.

  • 82% strongly agree or agree that the coaching was clear.

Hispanic/Latino

In summary, we see the following % agree or strongly agree with the above statements:

  • 50% strongly agree or agree that the coach seemed fully prepared for the coaching sessions.

  • 50% strongly agree or agree that the coaches made necessary adjustments based on their needs.

  • 100% strongly agree or agree that the coaches effectively built a safe learning environment.

  • 100% strongly agree or agree that the coaches demonstrated deep knowledge of the content they coach.

  • 50% strongly agree or agree that the coaching was clear.

Other

In summary, we see the following % agree or strongly agree with the above statements:

  • 0% strongly agree or agree that the coach seemed fully prepared for the coaching sessions.

  • 0% strongly agree or agree that the coaches made necessary adjustments based on their needs.

  • 0% strongly agree or agree that the coaches effectively built a safe learning environment.

  • 0% strongly agree or agree that the coaches demonstrated deep knowledge of the content they coach.

  • 0% strongly agree or agree that the coaching was clear.

White

In summary, we see the following % agree or strongly agree with the above statements:

  • 88% strongly agree or agree that the coach seemed fully prepared for the coaching sessions.

  • 88% strongly agree or agree that the coaches made necessary adjustments based on their needs.

  • 100% strongly agree or agree that the coaches effectively built a safe learning environment.

  • 100% strongly agree or agree that the coaches demonstrated deep knowledge of the content they coach.

  • 100% strongly agree or agree that the coaching was clear.

ELA

All Races

In summary, we see the following % agree or strongly agree with the above statements:

  • 73% strongly agree or agree that the coach seemed fully prepared for the coaching sessions.

  • 73% strongly agree or agree that the coaches made necessary adjustments based on their needs.

  • 91% strongly agree or agree that the coaches effectively built a safe learning environment.

  • 91% strongly agree or agree that the coaches demonstrated deep knowledge of the content they coach.

  • 82% strongly agree or agree that the coaching was clear.

Hispanic/Latino

In summary, we see the following % agree or strongly agree with the above statements:

  • 50% strongly agree or agree that the coach seemed fully prepared for the coaching sessions.

  • 50% strongly agree or agree that the coaches made necessary adjustments based on their needs.

  • 100% strongly agree or agree that the coaches effectively built a safe learning environment.

  • 100% strongly agree or agree that the coaches demonstrated deep knowledge of the content they coach.

  • 50% strongly agree or agree that the coaching was clear.

Other

In summary, we see the following % agree or strongly agree with the above statements:

  • 0% strongly agree or agree that the coach seemed fully prepared for the coaching sessions.

  • 0% strongly agree or agree that the coaches made necessary adjustments based on their needs.

  • 0% strongly agree or agree that the coaches effectively built a safe learning environment.

  • 0% strongly agree or agree that the coaches demonstrated deep knowledge of the content they coach.

  • 0% strongly agree or agree that the coaching was clear.

White

In summary, we see the following % agree or strongly agree with the above statements:

  • 88% strongly agree or agree that the coach seemed fully prepared for the coaching sessions.

  • 88% strongly agree or agree that the coaches made necessary adjustments based on their needs.

  • 100% strongly agree or agree that the coaches effectively built a safe learning environment.

  • 100% strongly agree or agree that the coaches demonstrated deep knowledge of the content they coach.

  • 100% strongly agree or agree that the coaching was clear.

Finally, here are some highlights from the qualitative feedback.

Responses to “What has gone well in your coaching sessions?”

Responses to “What could be better about your coaching sessions?”

Responses to “What additional feedback do you have about their coaching skills, if any?”

Section 2b: End of Coaching Feedback

Aggregate

All Races

In summary, we see the following % agree or strongly agree with the above statements:

  • 100% strongly agree or agree that they have applied or will apply what they have learned through coaching to their practice.

  • 100% strongly agree or agree that they were satisfied with the overall quality of the coaching they received.

  • 100% strongly agree or agree that the coaching supported me in being responsive to students’ backgrounds, cultures, and points of view.

  • 100% strongly agree or agree that they looked forward to attending the coaching sessions.

  • 67% strongly agree or agree that they talk to other teachers about the things they learned from coaching.

  • 67% strongly agree or agree that they were fully present/“minds-on” during the coaching sessions.- 100% strongly agree or agree that they were satisfied with the coaching they received.

  • 100% strongly agree or agree that the coaching was relevant to their instructional practices.

  • 100% strongly agree or agree that the strategies they’ve learned through coaching will improve their instruction.

  • 100% strongly agree or agree that the coaching was a good use of their time.- There is no data to show the % that strongly agree or agree that the strategies they’ve learned through coaching will improve their coaching or supervision or teachers.

Hispanic/Latino

In summary, we see the following % agree or strongly agree with the above statements:

  • 100% strongly agree or agree that they have applied or will apply what they have learned through coaching to their practice.

  • 100% strongly agree or agree that they were satisfied with the overall quality of the coaching they received.

  • 100% strongly agree or agree that the coaching supported me in being responsive to students’ backgrounds, cultures, and points of view.

  • 100% strongly agree or agree that they looked forward to attending the coaching sessions.

  • 0% strongly agree or agree that they talk to other teachers about the things they learned from coaching.

  • 100% strongly agree or agree that they were fully present/“minds-on” during the coaching sessions.- 100% strongly agree or agree that they were satisfied with the coaching they received.

  • 100% strongly agree or agree that the coaching was relevant to their instructional practices.

  • 100% strongly agree or agree that the strategies they’ve learned through coaching will improve their instruction.

  • 100% strongly agree or agree that the coaching was a good use of their time.- There is no data to show the % that strongly agree or agree that the strategies they’ve learned through coaching will improve their coaching or supervision or teachers.

White

In summary, we see the following % agree or strongly agree with the above statements:

  • 100% strongly agree or agree that they have applied or will apply what they have learned through coaching to their practice.

  • 100% strongly agree or agree that they were satisfied with the overall quality of the coaching they received.

  • 100% strongly agree or agree that the coaching supported me in being responsive to students’ backgrounds, cultures, and points of view.

  • 100% strongly agree or agree that they looked forward to attending the coaching sessions.

  • 100% strongly agree or agree that they talk to other teachers about the things they learned from coaching.

  • 50% strongly agree or agree that they were fully present/“minds-on” during the coaching sessions.- 100% strongly agree or agree that they were satisfied with the coaching they received.

  • 100% strongly agree or agree that the coaching was relevant to their instructional practices.

  • 100% strongly agree or agree that the strategies they’ve learned through coaching will improve their instruction.

  • 100% strongly agree or agree that the coaching was a good use of their time.- There is no data to show the % that strongly agree or agree that the strategies they’ve learned through coaching will improve their coaching or supervision or teachers.

ELA

All Races

In summary, we see the following % agree or strongly agree with the above statements:

  • 100% strongly agree or agree that they have applied or will apply what they have learned through coaching to their practice.

  • 100% strongly agree or agree that they were satisfied with the overall quality of the coaching they received.

  • 100% strongly agree or agree that the coaching supported me in being responsive to students’ backgrounds, cultures, and points of view.

  • 100% strongly agree or agree that they looked forward to attending the coaching sessions.

  • 67% strongly agree or agree that they talk to other teachers about the things they learned from coaching.

  • 67% strongly agree or agree that they were fully present/“minds-on” during the coaching sessions.- 100% strongly agree or agree that they were satisfied with the coaching they received.

  • 100% strongly agree or agree that the coaching was relevant to their instructional practices.

  • 100% strongly agree or agree that the strategies they’ve learned through coaching will improve their instruction.

  • 100% strongly agree or agree that the coaching was a good use of their time.- There is no data to show the % that strongly agree or agree that the strategies they’ve learned through coaching will improve their coaching or supervision or teachers.

Hispanic/Latino

In summary, we see the following % agree or strongly agree with the above statements:

  • 100% strongly agree or agree that they have applied or will apply what they have learned through coaching to their practice.

  • 100% strongly agree or agree that they were satisfied with the overall quality of the coaching they received.

  • 100% strongly agree or agree that the coaching supported me in being responsive to students’ backgrounds, cultures, and points of view.

  • 100% strongly agree or agree that they looked forward to attending the coaching sessions.

  • 0% strongly agree or agree that they talk to other teachers about the things they learned from coaching.

  • 100% strongly agree or agree that they were fully present/“minds-on” during the coaching sessions.- 100% strongly agree or agree that they were satisfied with the coaching they received.

  • 100% strongly agree or agree that the coaching was relevant to their instructional practices.

  • 100% strongly agree or agree that the strategies they’ve learned through coaching will improve their instruction.

  • 100% strongly agree or agree that the coaching was a good use of their time.- There is no data to show the % that strongly agree or agree that the strategies they’ve learned through coaching will improve their coaching or supervision or teachers.

White

In summary, we see the following % agree or strongly agree with the above statements:

  • 100% strongly agree or agree that they have applied or will apply what they have learned through coaching to their practice.

  • 100% strongly agree or agree that they were satisfied with the overall quality of the coaching they received.

  • 100% strongly agree or agree that the coaching supported me in being responsive to students’ backgrounds, cultures, and points of view.

  • 100% strongly agree or agree that they looked forward to attending the coaching sessions.

  • 100% strongly agree or agree that they talk to other teachers about the things they learned from coaching.

  • 50% strongly agree or agree that they were fully present/“minds-on” during the coaching sessions.- 100% strongly agree or agree that they were satisfied with the coaching they received.

  • 100% strongly agree or agree that the coaching was relevant to their instructional practices.

  • 100% strongly agree or agree that the strategies they’ve learned through coaching will improve their instruction.

  • 100% strongly agree or agree that the coaching was a good use of their time.- There is no data to show the % that strongly agree or agree that the strategies they’ve learned through coaching will improve their coaching or supervision or teachers.

Other

All Races

In summary, we see the following % agree or strongly agree with the above statements:

  • 100% strongly agree or agree that they have applied or will apply what they have learned through coaching to their practice.

  • 100% strongly agree or agree that they were satisfied with the overall quality of the coaching they received.

  • 100% strongly agree or agree that the coaching supported me in being responsive to students’ backgrounds, cultures, and points of view.

  • 100% strongly agree or agree that they looked forward to attending the coaching sessions.

  • 67% strongly agree or agree that they talk to other teachers about the things they learned from coaching.

  • 67% strongly agree or agree that they were fully present/“minds-on” during the coaching sessions.- 100% strongly agree or agree that they were satisfied with the coaching they received.

  • 100% strongly agree or agree that the coaching was relevant to their instructional practices.

  • 100% strongly agree or agree that the strategies they’ve learned through coaching will improve their instruction.

  • 100% strongly agree or agree that the coaching was a good use of their time.- There is no data to show the % that strongly agree or agree that the strategies they’ve learned through coaching will improve their coaching or supervision or teachers.

Hispanic/Latino

In summary, we see the following % agree or strongly agree with the above statements:

  • 100% strongly agree or agree that they have applied or will apply what they have learned through coaching to their practice.

  • 100% strongly agree or agree that they were satisfied with the overall quality of the coaching they received.

  • 100% strongly agree or agree that the coaching supported me in being responsive to students’ backgrounds, cultures, and points of view.

  • 100% strongly agree or agree that they looked forward to attending the coaching sessions.

  • 0% strongly agree or agree that they talk to other teachers about the things they learned from coaching.

  • 100% strongly agree or agree that they were fully present/“minds-on” during the coaching sessions.- 100% strongly agree or agree that they were satisfied with the coaching they received.

  • 100% strongly agree or agree that the coaching was relevant to their instructional practices.

  • 100% strongly agree or agree that the strategies they’ve learned through coaching will improve their instruction.

  • 100% strongly agree or agree that the coaching was a good use of their time.- There is no data to show the % that strongly agree or agree that the strategies they’ve learned through coaching will improve their coaching or supervision or teachers.

White

In summary, we see the following % agree or strongly agree with the above statements:

  • 100% strongly agree or agree that they have applied or will apply what they have learned through coaching to their practice.

  • 100% strongly agree or agree that they were satisfied with the overall quality of the coaching they received.

  • 100% strongly agree or agree that the coaching supported me in being responsive to students’ backgrounds, cultures, and points of view.

  • 100% strongly agree or agree that they looked forward to attending the coaching sessions.

  • 100% strongly agree or agree that they talk to other teachers about the things they learned from coaching.

  • 50% strongly agree or agree that they were fully present/“minds-on” during the coaching sessions.- 100% strongly agree or agree that they were satisfied with the coaching they received.

  • 100% strongly agree or agree that the coaching was relevant to their instructional practices.

  • 100% strongly agree or agree that the strategies they’ve learned through coaching will improve their instruction.

  • 100% strongly agree or agree that the coaching was a good use of their time.- There is no data to show the % that strongly agree or agree that the strategies they’ve learned through coaching will improve their coaching or supervision or teachers.

Several samplings of the textual feedback from the course survey are presented below.

Responses to “What is the learning that you are most excited about?”

Responses to “Which activities best supported your learning during the coaching support?”

Responses to “Overall, what went well during coaching?”

Responses to “Overall, what could have been better about the coaching?”

Responses to “Feel free to leave us any additional comments, concerns, or questions.”

Section 2c: Contact Lead Feedback

PL Provided

NPS

Responses to “What is going well about your partnership with Teaching Lab this year?”

Responses to “What could be improved about your partnership with Teaching Lab this year?”

Section 3: Participant Knowledge/Self-Reported Practices Assessments

For most PL courses, Teaching Lab administers a pre- and post- content knowledge or self-reported practice assessment. Below the pre and post averages are visualized by assessment.

Results

ELA ANA

ELA K-2 ANA

Section 4: Teachers’ Mindsets & School Environment

Participants complete Teaching Lab’s Educator Survey twice a year: at the beginning and end of their participation in PL. The survey collects data on teachers’ mindsets, perception and use of curricula, and perceptions of school culture and climate.

Section 4a: Teacher - Mindsets

Teachers responded to several items about mindsets, related to recognizing race and culture, the need for remediation, high expectations for all students, and growth mindsets on a 5-point Likert scale. Composite measures were created for each construct by reverse coding some items and then averaging responses across items. In this way, higher scores correspond to holding equitable mindsets.

The following are average scores by item calculated by the weighted quintile multiplied by a ratio on the scale of 0-1. Higher scores are better

See here for an example.

Overall

Recognition of Race & Culture

High Expectations

Growth Mindsets

Section 4b: Teachers - Perceptions and Use of Curricula

Teachers responded about the different curricula they use regularly and the most often. Overall we see the following results.

Aggregate

ELA

Teachers responded about the different curricula they use regularly and the most often. For ELA we see the following results.

Section 4c: Educators’ Perceptions of School Culture and Climate

Teachers’ Perceptions of School Leaders and CBPL

Teachers responded to items about their perceptions of school leaders and PL environment.

Teachers’ Perceptions of School Environment

Teachers responded to items about their school environment.

Section 5: Teachers’ Instructional Practices

Teachers report on their instructional practices in the Educator Survey and some are observed by Teaching Lab staff.

Section 5a: Teachers’ CRSE Self-Reported Practices

Participants complete Teaching Lab’s Educator Survey twice a year: at the beginning and end of their participation in PL. The survey collects data on self-reported culturally responsive and sustaining education (CRSE) practices.

Section 5b: Direct-to-Teacher Coaching Observations

Teaching Lab has the opportunity to observe some participants over the course of their participation in PL. Below are the results of the initial classroom observations conducted using the IPG Math and ELA Tools, in addition to the FSOT. Ratings of 3 and 4 on 4-point Likert scales and Yes on a Yes/No items were considered positive.

Overall Positive Indicators

ELA

K-2 ELA

Section 6: Student Outcomes

Some teachers will administer a student survey to at least one of their groups. Using 5-point Likert-type scales, students will respond to items related to their teachers’ engagement in CRSE practices, teacher-student relationships, self-efficacy, happiness and sense of belonging, and being challenged.

Section 6a: Student Learning Experiences

CRSE

All

American Indian or Alaska Native

Hispanic/Latino

Teacher-Student Relationships

All

American Indian or Alaska Native

Hispanic/Latino

Self Efficacy

All

American Indian or Alaska Native

Hispanic/Latino

Happiness and Belonging

All

American Indian or Alaska Native

Hispanic/Latino

Being Challenged

All

American Indian or Alaska Native

Hispanic/Latino

Section 6b: % On Grade Level

Section 6c: Student Performance on Grade-Level Tasks

 

Return to Website

info@teachinglab.org